Scalable ultra-sensitive detection of heterogeneity via coupled bistable dynamics 
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We demonstrate how the collective response of N globally coupled bistable elements can strongly 
reflect the presence of very few non-identical elements in a large array of otherwise identical elements. 
Counter-intuitively, when there are a small number of elements with natural stable state different 
from the bulk of the elements, all the elements of the system evolve to the stable state of the 
minority due to strong coupling. The critical fraction of distinct elements needed to produce this 
swing shows a sharp transition with increasing N, scaling as 1/s/N. Furthermore, one can find a 
global bias that allows robust one bit sensitivity to heterogeneity. Importantly, the time needed to 
reach the attracting state does not increase with the system size. We indicate the relevance of this 
ultra-sensitive generic phenomenon for massively parallelized search applications. 



The complex interactive systems modelling spatially 
extended physical, chemical and biological phenomena, 
has commanded intense research effort in recent years. 
One of the important issues in such systems is the effect 
of hetcrogeniety on spatiotcmporal patterns. The role of 
disorder, such as static or quenched inhomogenicties, and 
the effect of coherent driving forces, has yielded a host 
of interesting, often counter-intuitive, behaviours. For 
instance, stochastic resonance [l[ in coupled arrays 0, 
diversity induced resonant collective behaviour in ensem- 
bles of coupled bistable or excitable systems Q demon- 
strated how the response to a sub-threshold input signal 
is optimized. However, the potential of coupled system 
for parallel information processing remains largely unex- 
plored. It is our aim to show the existence of an ultra- 
sensitive regime of iV-couplcd bistable elements whereby 
small heterogeneity in the system strongly influence its 
global dynamics. 

Here we consider N coupled nonlinear systems, where 
the evolution of element i (i = 1, . . . N) is given by: 



Xi = F(xi) + ai + C((x) - Xi ) + b 



(1) 



where C is the coupling strength, b is a small global bias, 
and the mean held (x) is given by 
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The function F(x) is nonlinear and yields a bistable po- 
tential. Specifically, we consider F(x) = Xi — xf , which 
gives rise to a double-well potential, with one well cen- 
tered at x*_ = — 1 (lower well) and another at x+ = +1 
(upper well). 

We consider a situation where a, can take either of 
two sufficiently different values, A and A\. With no loss 
of generality, we set A = and A% = 1, i.e. a, of the 
elements i = 1, . . . N, can be or 1. The initial conditions 
on N elements here are taken to be randomly distributed 
about zero mean, and in our simulations a very large 
number of initial states (~ 10 4 ) are sampled in different 
trial runs. In order to quantify what fraction of elements 



have a, = 0, we use the following notation: Nq is the 
number of elements with a% = 0, and N\ = N — Nq is the 
number of elements with Oj = 1. The principal question 
is: how sensitive are collective dynamical features, such 
as the ensemble average (x) , which can be considered as 
the output of the system, to small inhomogeneity [see Fig. 
1(a)]. 

The values Aq, A\ and bias b are such that in an un- 
coupled system, when a; = Aq, the system goes rapidly 
to the lower well x*_ ~ —1, while the system with a% = A\ 
is attracted to the upper well x*, ~ 1. When all at = Aq, 
we have a homogeneous system, and this uniform system 
is naturally attracted to the lower well x*_ . One may won- 
der, how many a, need to be different from in order to 
make a significant difference in the collective output. 

Intuitively, one may expect that the global average will 
pick up contributions of order 1 /N from each element. So 
a fairly large number of elements need to be different in 
order to obtain significant deviation in the mean field 
and drive a different collective response. Alternately, for 
strong coupling, one may think, for small heterogeneity, 
the majority of the elements will dictate the nature of the 
collective field, as the minority should synchronize with 
the majority population. 

However, we will show here that both the expectations 
above do not hold true. Instead, this system, under suffi- 
ciently strong coupling, will evolve to the stable state of 
the minority population. Furthermore, the critical num- 
ber of elements distinct from the bulk that is needed for 
this effect, is typically less than 0(y/~N), and can actually 
be made as small as one. 

Figure 1(b) shows the evolution of 100 globally coupled 
elements, with coupling constant C = 1, to the lower well 
from Gaussian random initial conditions, in the homoge- 
neous case where all cij = 0. In sharp contrast, Fig. 1(c) 
shows all the elements of the array being attracted to 
the upper well, when a few elements have a; = 1 . So it is 
clearly evident that even when very few aiS are different 
from 0, the entire array is pushed to the upper well. 

So the collective field sensitively reflects very small de- 
viations from uniformity. In fact, the response to small 
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FIG. 1. (a) Schematics of coupled nonlinear system with N- 
inputs, output, bias, and reset for initial conditions, (b) time 
evolution of an array of 100 strongly coupled (C = 1) bistable 
elements having all at = in Eq.(l), and (c) having 10 ele- 
ments with a* = 1 (denoted by arrows) and 90 elements with 
CLi = 0. 

diversity is a swing from the lower well to the upper one, 
for all elements in the system. The coupled system then 
acts like a sensitive detector, as its response to few <Zj = 1, 
in an otherwise uniform lattice of otj = 0, is very large. 

Coupling is crucial in this effect. In a weakly cou- 
pled system, when a few ai are different, the difference in 
the mean field of the homogeneous and inhomogeneous 
systems will be proportional to Ni/N. However, the re- 
sponse of the strongly coupled system to small Ni is very 
large (namely ~ {x*\_ — x*_)). 

In order to quantify the sensitivity of the collective 
response, we calculate the minimum N\ needed to flip 
the output to the upper well (within a small prescribed 
accuracy). We call this the critical population N\ c . 

Figure [2] displays the collective response to very small 
inhomogencity under varying system size N and global 
bias b. In Fig. Ufa), we show the probability, P, that all 
the oscillators evolve to the upper well, as a function of 
/ = Ni/N for different system sizes for a bias b = —0.05 
and coupling constant C = 1. The figure shows that 
there is a critical fraction above which all the oscillators 
switch to the upper well. The switching becomes sharper 
and sharper as the system size increases. To obtain the 
critical population, N± c in the large N limit, we use the 
finite size scaling. For a given bias and coupling constant, 
the probability P satisfies the following scaling form 

p ~ g (N*(f - f c )) , (3) 

where f c = Ni c /N when N — > oo, is the critical expo- 
nent and Q is the scaling function. A good data collapse, 
shown in Fig. EJb), is obtained for <f> = 1/2 indicating 
that 

l/_/ c |~_!==j>|jvi-j\r lc | ~Vn. (4) 

Clearly then, the minority population can pull the 
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FIG. 2. (a) Probability, P, that all the elements evolve to the 
upper well, from random initial conditions, as a function of 
fraction / = N\/N for different system sizes. Here bias b = 
—0.05, coupling constant C = 1, and averaged over 10,000 
runs, (b) Data collapse of probability P for various N as 
obtained by scaling the x-axis by N 1 ^ 2 (f — f c ), indicates that 
fc is 0.075 ± 0.001 for this bias. Inset: scaling of / — f c with 
respect to N, where / is the fraction at which P ~ 1; solid 
line: 1/y/W fit. (c) P vs global bias b, for different system 
sizes, with / = Ni/N = 0.075. 

strongly coupled bistable system to a final state distinct 
from the homogeneous case. 

One may wonder if the fundamental one-bit detection 
limit can be achieved in our system. In Fig. [31 we have 
shown how a large system, N = 1000, responds to only 
one distinct element in the array. It demonstrates that 
there exist a range of global bias which allows the system 
to yield P = for Ni = and P = 1 when N\ = 1. So 
by tuning the global bias we can obtain a system where 
a single a% = 1 can draw the whole system to the upper 
well. 

Specifically then, in the representative example dis- 
played in Fig|3J in a lattice of 100 elements, when all 
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FIG. 3. (Top Panel) Probability, P, that all the oscillators 
evolve to the upper well as a function of global bias, for a 
system of 1000 elements: (right curve) with no a, = 1, namely 
/ = Ni/N — and (left curve) with just one element with 
at = 1, namely / = Ni/N = 0.001 (left curve). The red 
(solid) line shows the deterministic case with all initial x = 
0. The green (dashed) curve shows the evolution from an 
initial system with states drawn from a Gaussian distribution, 
with small standard deviation (~ 0.01), centered around zero. 
(Bottom panel) time evolution of the elements in the array of 
size N = 100, where only one element has a 1 = 1 (denoted 
by arrow) and 99 elements have a,i = 0. 



a, = the mean field is ~ — 1, reflecting the fact that 
all elements go to the lower well, as expected. However, 
when one of the a% is 1 (i.e. N\ =1,Nq = 99), the mean 
field evolves to ~ 1, reflecting the fact that all elements 
have been attracted to the upper well now, driven by this 
one different clement. So even though only one element 
in the array would have evolved to the upper well in the 
uncoupled case, when strongly coupled, all 100 elements 
are dragged rapidly to the upper well. 

One can analyze the dynamics by considering (x) = 
x av + 77, where 77 is a random fluctuation about the true 
thermodynamic average x av (~ 0), with r\ ~ 1/y/N. So 
the effective dynamics of each element is: 

C 

Xi = (l-C)xi-xf + a l + b + Cx av + —=ri = F(xi) + Dr] 

v ./V 



(5) 

The probability P(x) of obtaining the system in state 
x for the elements, can be analyzed by solving for the 
steady state distribution arising from the relevant Fokker 
Planck equation, namely P(x) = Aexp(— 2<p(x)/D) 
where A is a normalization constant, D = C/V~N is the 
strength of the random fluctuations, and —dcf>(x)/dx = 
F(x) Using this we verify that the uncoupled sym- 




FIG. 4. Evolution of the mean field as a function of time for 
different array sizes: 100 (red solid), 1000 (black dashed) and 
10000 (blue dotted), with iVi/iV = 0.01 and bias b = -0.005. 
Clearly, the time needed to reach the attracting state does 
not depend on N. 



metric case, i.e. with C — and 6 = 0, yields the fol- 
lowing: elements with a, = yield equal probability of 
residence in either of the two wells (centered around 1 
and —1), and for elements with a% — 1 the probability 
P{x) shifts entirely to the upper well (~ 1). When there 
is no coupling or very weak coupling, this is indeed the 
case in our simulations as well. 

However, for strong coupling (C ~ 1), we have a very 
different scenario: when all a, = (with N — > 00) and 
even the slightest negative bias, P{x) peaks sharply in 
a well with x < 0. That is, the entire system is syn- 
chronized and attracted to the lower well. Contrast this 
to the unsynchronized situation in weak coupling, where 
the elements go to either upper or lower well depending 
on their initial state. Similarly, for strong coupling, even 
slight positive bias drives all the elements to the upper 
well. 

Now consider the strong coupling case with a few <Zj = 
1. The elements with a,i = 1 have P (x) centered sharply 
at a well ~ 1 (as at acts as a positive bias) . As these N\ 
elements evolve to the upper well, x av becomes slightly 
positive, and even elements with en = experience a 
positive bias: b + Cx av > 0, which shifts P(x) entirely to 
a well at x > 0. Following the small initial positive push, 
there is a strong positive feedback effect that drives the 
x m to more and more positive values, and consequently 
the stable attracting well shifts rapidly towards ~ x* + . 

One can also rationalize this mechanism intuitively as 
follows: when the initial system has x ~ 0, namely the 
system is poised on the "barrier" between the two wells, 
the state is tipped to the well at x* + if x > and to the 
lower well at x*_ if x < 0. Now, initial Fix) ~ as the 
system is at the unstable maximum of the potential, and 
ii ~ a.i + b+ ((x) — Xi), where b is close to 0, and (x) —x,i 
is small in magnitude. So for elements with a; = 1, 
x ~ 1, and for dj = 0, x is also positive, though small 
in magnitude, as x% < (x). After this infinitesimal initial 
push towards x* + , all elements evolve rapidly towards that 
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stable upper well, as F(x) gets increasingly positive. 

Robustness of the phenomena: In order to gauge the 
generality of our observations, we have considered dif- 
ferent nonlinear functions F(x) in Eq.(l). For example, 
we explored a system of considerable biological interest, 
namely, a system of coupled synthetic gene networks. We 
used the quantitative model, developed in Q , describing 
the regulation of the operator region of A phase, whose 
promoter region consists of three operator sites. The 
chemical reactions describing this network, given by suit- 
able rescaling yields Q 

. . _ m(l + x 2 + aaix 4 ) 

1 + X Z + (TlX 4 + 0-\O-2,X° 

where x is the concentration of the repressor. The non- 
linearity in this F(x) leads to a double well potential, 
and different 7 introduces varying degrees of asymmetry 
in the potential. We studied a system of coupled genetic 
oscillators given by: ii = F gene (xi) + C ((x) — Xi) + a.i + b, 
where C is the coupling strength, and b is a small global 
bias. We observe similar features in this system as well. 

In addition, we studied various different coupling 
forms. For instance, a system of ./V coupled nonlinear 
systems, where the evolution of element i is given by: 

Xi = F(xi) + a,i + C(x) + b (6) 

where C is the coupling strength and (x) is the mean 
field given by Eq.([2|). Furthermore, we considered small 
world networks, where varying sets of regular links were 
replaced by random connections. Lastly, we explored 
networks with different ranges of coupling, namely the 
coupling occured over increasingly large subsets of neigh- 
bours, up to the global coupling limit. Qualitatively, the 
same ultra-sensitivity to heterogeneity has been observed 
for all these different dynamical systems and coupling 
forms. 

Relevance to Information Search: Lastly, we address 
a problem of database searching, utilizing these strongly 
coupled bistable dynamical systems as the building block 
of the search engine. We propose a method, involving a 
single global operation, to determine the existence of very 
few specified items in a given, arbitrarily large, unsortcd 
database. 

First we use the bistable elements to stably encode N 
binary items (0 or 1) by setting a, (i = 1, . . . N) to take 
values or 1, respectively [sec Fig. 1(a)]. This creates 
a (unsorted) binary database. Then, using the scalable 
ultra-sensitivity demonstrated above, one can search this 
arbitrarily large database for the existence of a single 
different bit (say a single 1 in a string of 0's) by making 
just one measurement of the evolved mean field of the 
whole array. 

Furthermore, we have a look-up table relating critical 
Ni to global bias b (cf. Fig. [3]). So by sweeping b we can 
find where the cross-over to the upper well occurs. This 



average critical value can be used to gauge the number 
of ones present in the system as well. 

The significant feature here that allows this massive 
parallelization, is the fact that the time taken to reach 
the attracting mean field value does not scale with system 
size (see Fig.0J. In fact the time taken to reach the mean 
field that encodes the output is independent of N. 

Another important feature of this scheme is that it 
employs a single simple global operation, and does not 
entail accessing each item separately at any stage. In 
comparison, for example, a conventional search algorithm 
with binary encoding will take O(logN) procedural steps 
for binary search of an ordered tree |5[. In addition, 
there is the time required for ordering, which typically 
scales as 0(N x logN). Alternate ideas to implement the 
increasingly important problem of search have included 
the use of quantum computers Q , which involves scaling 
of time steps as 0(\/N). 

In summary, the collective response of N globally cou- 
pled bistable elements can strongly reflect the presence 
of very few non-identical elements in a very large array 
of otherwise identical elements. Counter-intuitively, the 
mean field evolves to the stable state of the minority pop- 
ulation, rather than that of the bulk of the array. Adjust- 
ing the global bias enables us to observe robust one bit 
sensitivity to diversity in this array. Further, the time 
needed to reach the attracting state does not increase 
with system size. Thus this phenomenon has much rel- 
evance to the problem of massively parallelized search. 
Lastly, this scalable ultra-sensitivity is a generic and ro- 
bust phenomenon, and can potentially be observed in so- 
cial and biological networks Q , coupled nano- mechanical 
resonators Q, and coupled laser arrays Q. 
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